Papers with multimodal spatial understanding
Decoding Language Spatial Relations to 2D Spatial Arrangements (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Using a model architecture, we decode text to 2D spatial arrangements in a multi-object and multi-relationship setting. |
| Approach: | They propose a model architecture Spatial-Reasoning Bert that decodes language to 2D spatial arrangements in a multi-object and multi-relationship setting. |
| Outcome: | The proposed model can generate complete abstract scenes if paired with a clip-arts predictor and can generalize to out-of-sample data to a reasonable extent. |